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Presentation  Objectives 


•  Background 

-  NAVAIR 

-  Personal  Software  Process  (PSP)  and 
Team  Software  Process  (TSP)1 

-  TSP  Workbook  and  Process  Dashboard  tools 

•  Strengths  and  Weaknesses  of  Tools 

-  Planning  Phase  (TSP  Launches) 

-  Plan  Execution  Phase  (Daily  Use) 

-  Analysis  of  Plan  Execution  (Postmortems) 

'Personal  Software  Process,  PSP,  Team  Software  Process,  and  TSP  are  service  marks  of  Carnegie  Mellon  University 
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Who  is  NAY  AIR? 


•  NAY  AIR  is  the  Naval  Air  Systems  Command. 

•  We  develop,  acquire,  and  support  the  aircraft  and  related 
weapons  systems  used  by  the  U.  S.  Navy  and  Marine  Corps. 

•  We  translate  the  needs  of  the  Navy  and  Marine  Corps  into  the 
technical  and  financial  requirements  needed  by  industry  to 
actually  produce  an  aircraft  or  other  weapon  system. 

•  Our  goal  is  to  provide  the  fleet  with  quality  products  that  are  both 
affordable  and  available  when  they  are  most  needed. 

•  Our  support  extends  across  the  entire  life  span  of  a  product, 
including  all  upgrades  and  modifications  to  that  product. 
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Who  is  NAY  AIR? 
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What  is  PSP/TSP? 


•  PSP  shows  software  professionals  how  to 

-  plan  and  track  their  personal  work 

-  define  processes  that  best  suit  them 

-  measure  and  manage  cost,  schedule,  and  quality 

•  TSP  shows  teams  of  PSP-trained  professionals 
how  to 

-  establish  realistic  commitments 

-  keep  management  informed 

-  deliver  quality  products 

-  minimize  project  cost  and  schedule 
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PSP/TSP  Benefits 


•  PSP/TSP  quickly  improves  the  performance  of  software 
groups. 

•  Planning  and  tracking  is  accurate,  timely,  and  precise. 

•  Product  quality  is  managed  and  measured  from  the 
beginning  of  the  job. 

•  By  finding  and  fixing  problems  before  test,  project 
cycle  time  is  substantially  reduced. 
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What  is  TSP  Workbook? 


•  Created  by  Software  Engineering  Institute 
(SEI)  at  Carnegie  Mellon  University 

-  Automates  implementation  of  TSP/PSP  concepts 

-  Enables  software  engineers  to  focus  on  work 

-  Uses  Microsoft  Excel  and  Visual  Basic  macros 


NAVAIR  Software/Systems  Support  Center  (NSSC) 


Slide  7 


nav^^ai  r 


TSP  Workbook  -  S/W  Task  List 
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TSP  Workbook  -  EV  Chart 


Cumulative  Earned  Value 
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Wrap  What  is  Team  Dashboard? 


•  Created  by  the  Air  Force  Software  Technology 
Support  Center  (STSC) 

-  Automates  implementation  of  TSP/PSP  concepts 

-  Enables  software  engineers  to  focus  on  work 

-  Uses  Java  scripts 

-  Filled  need  for  a  PSP/TSP  tool  for  use  on  Unix- 
based  computers  (tool  also  works  on  Windows- 
based  computers) 
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Team  Dashboard  -  s/w  Task  List 


^  Task  and  Schedule  Rollup 


Project/Task 

PT 

Time 

PV 

Plan  Date 

Date 

%C 

%s 

EV 

?  p5]  Move-Add  Buttons 

o-  d  HLD  Task 

0:22 

0:32 

0.1% 

Mar  19,  2006 

Mar  17,  2006 

100% 

143% 

0.1% 

o-  PI  HLD  InspectTask 

0:07 

0:15 

0% 

Mar  26,  2006 

Mar  22,  2006 

100% 

208% 

0% 

?  a 

DSP 

Planning 

0:47 

1:14 

0.2% 

Mar  19,  2006 

Mar  17,  2006 

100% 

156% 

0.2% 

Design 

5:00 

2:18 

1% 

Mar  26,  2006 

Mar  20,  2006 

100% 

46% 

1% 

"^1  Design  Review 

1:23 

0:13 

0.3% 

Mar  26,  2006 

Mar  20,  2006 

100% 

16% 

0.3% 

^  Code 

4:16 

2:39 

0.9% 

Mar  26,  2006 

Mar  21 ,2006 

100% 

62% 

0.9% 

"^1  Code  Review 

1:31 

0:03 

0.3% 

Mar  26,  2006 

Mar  21, 2006 

100% 

3% 

0.3% 

Compile 

0:17 

1:29 

0.1% 

Mar  26,  2006 

Mar  22,  2006 

100% 

516% 

0.1% 

1  Test 

3:58 

5:15 

0.8% 

Mar  26,  2006 

Mar  23,  2006 

100% 

132% 

0.8% 

1  Postmortem 

0:47 

1:34 

0.2% 

Apr  9,  2006 

Apr  5,  2006 

100% 

198% 

0.2% 

o-  p5]  Test  Plan 

0:06 

0:01 

0% 

Mar  26,  2006 

Mar  20,  2006 

100% 

15% 

0% 

o-  p^  Design  InspectTask 

0:56 

0:21 

0.2% 

Mar  26,  2006 

Mar  22,  2006 

100% 

37% 

0.2% 

o-  p^  Test  Devel  Task 

0:19 

0:05 

0.1% 

Mar  26,  2006 

Mar  20,  2006 

100% 

27% 

0.1% 

o-  p^  Code  InspectTask 

1:52 

3:40 

0.4% 

Apr  9,  2006 

Apr  4,  2006 

100% 

197% 

0.4% 

Q-  PI  IntTestTask 

1:28 

0:00 

0.3% 

Apr  9,  2006 
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Team  Dashboard  -  EV  Chart 
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What  is  a  TSP  Launch? 


Meeting  1 

Tools  used 

Review  Management  goals.  f°r  these  steps 

Meeting  2 

Set  SAV  Team  goals.  J 

Meeting  3 

Produce  development  strategy  and  process. 

Meeting  4 

Produce  top-down  plan. 

Meeting  5 

Review  quality  plan. 

Meeting  6 

Produce  bottom-up  plan  (detailed  individual  plans). 

Meeting  7 

Perform  risk  assessment. 

NAVAIR  Software/Systems  Support  Center  (NSSC) 
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TSP  Launches  -  TSP  Workbook 


•  Strengths 

-  Top-down  plan  is  easy  to  enter  real-time 

-  Quality  Plan  is  generated  automatically 

-  Non-software  development  efforts  are  supported 

-  User  tool  training  is  reduced  (COTS-based) 

•  Weaknesses 

-  Balancing  workloads  is  time-consuming  (at  times) 

-  Implementing  personal  rates  is  error-prone 

-  Producing  bottom-up  plan  requires  all  team 
members  to  use  tool 
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TSP  Workbook  -  Lifecycle  Processes1 


J File  Edit  View  Insert  Format  lools  Data  Window  Help  -  Ifi1!  xl 


JD  &  Q  S 

#a? 

x  %  ® 

%  £  A  zl  aI  U 

100%  - 

10  - 

B 

-= 

□  -  <3*  -  ? 

E23 ^] 


c 

D 

E 

3 — f — 

L  G 

2L 

1 

Process 

Process  Step 

Process  Step  Description 

TSP  Phase 

Step  %  i 

2 

3 

STR  Lite  Lifecycle  Process 

Prob  Identification 

Identify  Cause  of  Problem 

IDENT 

29.7% 

4 

STR  Lite  Lifecycle  Process 

In  Work 

Implement  Solution  to  Problem 

INWRK 

41.8% 

5 

STR  Lite  Lifecycle  Process 

Inspection 

Prepare,  attend,  and  fix  and  problems  encountered  in 

inINSP 

18.5% 

6 

STR  Lite  Lifecycle  Process 

Integration  Test 

Integration  Test 

IT 

10.0% 

7 

Classic  Lifecycle  Process 

Detailed  Design 

Complete  Detailed  Design 

DLD 

22.1% 

in 

8 

Classic  Lifecycle  Process 

DLD  Review 

Personal  Review  of  Detailed  Design 

DLDR 

11.1% 

n 

9 

Classic  Lifecycle  Process 

DLD  Inspection 

Prepare,  attend,  and  fix  and  problems  encountered  in 

inDLDINSP 

8.8% 

in 

10 

Classic  Lifecycle  Process 

Code 

Complete  Code 

CODE 

20.0% 

si 

11 

Classic  Lifecycle  Process 

Code  Review 

Personal  Review  of  Code 

CR 

10.0% 

i§ 

12 

Classic  Lifecycle  Process 

Compile 

Compile  and  fix  and  bugs  and  continue  this  process  uni  COMPILE 

3.4% 

il 

13 

Classic  Lifecycle  Process 

Unit  Test 

Unit  Test 

UT 

6.8% 

it 

14 

Classic  Lifecycle  Process 

Code  Inspection 

Prepare,  attend,  and  fix  and  problems  encountered  in 

in  CODEINSP 

8.8% 

ii 

15 

Classic  Lifecycle  Process 

Integration  Test 

Integration  Test 

IT 

9.0% 

▼ 

H  i 

►  Hi/  PseudoSUMS  /  ProcessList  \ProcessDefinition/^PseudoTA5K  /  PseudoTASK  \<  | 

mmiir 

Draw  ▼  AutoShapes  -  \  \  Q  O  [=]  30  &  w  ^  w  A,  ’r  =  ~=  ^  Q  [  , 


Ready 

■ 

i 

NUM 

— 

1 

jP 

//. 

1  -  Launch  Assistant  tool  provided  by  Advanced  information  Services  (AIS) 
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TSP  Workbook  -  Load  Leveling 


c 

K 

L  M 

N 

O 

■J. 

O 

R 

tinplate  -  Form  TASK 

- 

H  H 

-J 

Tola  , 

an  Hou 

w  \ 

Draft  a  Design  Standard  for  the  team 

aa 

5.0 

1.0 

Team  Review  and  comment  on  standard 

team 

2.0 

3.0 

6.0 

Improve  standard  based  on  comments 

aa 

2.0 

1.0 

2.0 

Issue  the  standard  to  the  team 

aa 

0.5 

1.0 

0.5 

Core  Requirements  REQINSP  -  inspection 

aa,  cc 

55  pgs 

2.0 

27.5 

3.0 

82.5 

Core  Requirements  REQINSP  -  meeting 

bb,  aa,  cc 

1.0 

0.0 

"A"  Requirements  REQ- write  requirements 

aa 

45  pgs 

0.5 

90.0 

1.0 

90.0 

"A”  Requirements  REQINSP  -  meeting 

aa,  bb,  dd 

1.0 

0.0 

"A"  Requirements  REQINSP  -  resolve  issue 

aa 

5.0 

1.0 

5.0 

Core  SW  DLDINSP  -  Inspection 

aa,  bb 

500  LOC 

200.0 

2.5 

3.0 

7.5 

Core  SW  DLDINSP  -  Inspection  Meeting 

cc,  aa,  bb 

1.0 

3.0 

3.0 

Core  SW  CODEINSP  -  Inspection 

aa,  bb 

500  LOC 

200.0 

2.5 

3.0 

7.5 

Core  SW  CODEINSP-  Inspection  Meeting 

cc,  aa,  bb 

1.0 

3.0 

3.0 

"A"  SW  DLD 

aa 

1000  LOC 

15.0 

30.0 

20.0 

1.0 

20.0 

"A"  SW  DLDR 

aa 

1000  LOC 

15.0 

15  0 

10.0 

1.0 

10.0 

"A"  SW  DLDINSP  -  Inspection  Meeting 

aa,  bb,  cc 

1.0 

3.0 

3.0 

"A"  SW  DLDINSP  -  Resolve  Issues 

aa 

2.0 

1.0 

2.0 

"A"  SW  CODE 

aa 

1000  LOC 

15.0 

30.0 

20.0 

1.0 

20.0 

"A"  SW  CR 

aa 

1000  LOC 

15.0 

10.0 

6.7 

1.0 

6.7 

"A"  SW  CODEINSP-  Inspection  Meeting 

aa,  bb,  cc 

1.0 

3.0 

3.0 

"A"  SW  CODEINSP  -  Resolve  Issues 

aa 

2.0 

1.0 

2.0 

"A"  SW  COMPILE 

aa 

1000  LOC 

15.0 

3.0 

2.0 

1.0 

2.0 

"A"  SW  UT 

aa 

1000  LOC 

15.0 

12.0 

8.0 

1.0 

8.0 

9 ; 
1( 


Click  on  the  “P”  (Plan  Hours) 
Column,  and  the  entire  column 
will  be  selected. 


1/8720cra 


EXCEL  will  display  the  “SUM”, 
the  total  effort  hours,  planned  for 
aa. 


11/8. 

11/8/2004  13 

i  — 

v 

11; 

11; 

11; 

11; 

11/1 

11/1 5/2004 
12/6/2004 
12/6/2004 
12/6/2004 
12/6/2004 


QualGuide  /  Project  /  Team  /  Goals  /  Roles  /  SUMP  /  SUMQ  /  SUMS  Task /  Schedule  /  LOGT  /  LOGO  /  Weeh  /  IRTL  /  IRVeeh  /  DefectTupes  /  QPrt 

□  034  O  m  J  3.^'A’gsS'l  J- 


Sum=213.7 
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JSP  Launches  —  Team  Dashboard 


•  Strengths 

-  Top-down  plan  is  easy  to  enter  real-time 

-  Quality  Plan  is  generated  automatically 

-  Non-software  development  efforts  are  supported 

-  Balancing  team  workloads  is  quick  &  easy 

-  Tool  familiarity  is  not  required 

•  Weaknesses 

-  Some  tool  workarounds  require  explanation 
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Team  Dashboard  -  Non-SAV  Workflow 


1  Team  Project  -  Common  Team  Workflows 

¥  0  ©  ■=>  <?  t® 

Name 

% 

Rate 

Units 

#  People 

ri  Common  Workflows 

□  ffl  Crisis  Management 

£7  Planning 

5%  of 

3 

Crises  per  Hour 

1  person 

£7  Stop 

1  0%  of 

3 

Crises  per  Hour 

1  person 

£7  Drop 

1  0%  of 

3 

Crises  per  Hour 

1  person 

£7  Roll 

40%  of 

3 

Crises  per  Hour 

1  person 

£7  Postmortem 

35%  of 

3 

Crises  per  Hour 

1  person 
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Team  Dashboard  -  Non-SAV  Task  List 


NAVAIR  Software/Systems  Support  Center  (NSSC) 


Slide  21 


NAVj^A  I  R 


Daily  Use  -  TSP  Workbook 


•  Strengths 

-  Logging  time  and  defects  is  easy 

-  Changing  order  of  tasks  is  easy 

-  User  ramp-up  time  is  short  (COTS-based) 

•  Weaknesses 

-  Additional  steps  required  to  build  team  status 

-  No  support  for  PROBE  analysis 
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C  TSP  Workbook  -  Time  and  Defect  Logs 


Name  Robert  N  Lindeman 

Date 

Cycle 

Hours 

5/3/2006 

Team  MSS  Team 

91.6 

Assembly  Phase 

Task 

Date 

Start 

Int. 

Stop 

Delta 

Comments 

UPC  AMU  RS  f  CODE 

UPC  AMU  RS  Access  DB  Create  -  Data  Entry 

8/6/2004 

11:40:24 

0.0 

11:40:26 

0.0 

PB  done 

UPC  AMU  RS  f  CODE 

UPC  AMU  RS  Access  DB  Create  -  Data  Entry 

8/6/2004 

11:40:36 

0.0 

12:00:40 

20.1 

Net  done 

UPC  AMU  RS  /CODE 

UPC  AMU  RS  Access  DB  Create  -  Data  Entry 

8/6/2004 

12:03:04 

0.0 

12:06:18 

3.2 

delete  all  traces  of  pilot  data  file 

UPC  AMU  RS  /CODE 

UPC  AMU  RS  Access  DB  Create  -  Data  Entry 

8/6/2004 

12:06:32 

0.0 

12:34:11 

27.7 

corrected  and  remove  inapplicable  personalite 

UPC  AMU  RS/CR 

UPC  AMU  RS  Access  DB  Createe  -  Data  Entry 

8/6/2004 

12:36:11 

0.0 

12:39:21 

3.2 

done  reveiw  of  the  OC1 .2  changes 

UPC  AMU  RS/CR 

UPC  AMU  RS  Access  DB  Createe  -  Data  Entry 

8/6/2004 

12:39:38 

0.0 

12:45:38 

6.0 

done 

UPC  AMU  RS  /  CODEINSP 

UPC  AMU  RS  Access  DB  Create  -  Data  Entry  Ir 

8/6/2004 

12:46:57 

0.0 

13:09:46 

22.8 

sent  out  request  to  review 

UPC  AMU  RS  /  DLDINSP 

UPC  AMU  RS  Access  DB  Create  -  DLD  Inspect 

8/11/2004 

10:52:47 

0.0 

10:52:55 

0.1 

1 

UPC  AMU  RS  /  DLDR 

UPC  AMU  RS  Access  DB  Create  -  DLD  Review 

8/11/2004 

10:53:40 

0.0 

11:17:56 

24.3 

will  have  review  sessions  for  construction  an| 

UPC  AMU  RS 
UPC  AMU  RS 
UPC  AMU  RS 
UPC  AMU  RS 
UPC  AMU  RS 
UPC  AMU  RS 


/DLL 
f  COD 
/COt 
[DLL 
[COt 
[CO[ 


TSP  Defect  Recording  Log 

Name  Robert  N  Lindeman 


Form  LOGD 


Team  MSS  Team 


Date  5/3/2006 
Cycle _ 


Date 

Num 

Type 

Assembly 

Injected 

Removed 

Fix 

Time 

Fix 

Ref. 

Description 

8/2/2004 

9 

10 

UPC  AMU  RS  DSUUAPI  In  PVCS 

DLD 

DLDINSP 

10.0 

move  interp  layer  to  same  level  as  rule  server 

8/2/2004 

10 

10 

UPC  AMU  RS  DSUUAPI  In  PVCS 

DLD 

DLDINSP 

10.0 

move  interface  stack  and  scsil  553  to  its  own  folder 

8/2/2004 

11 

10 

UPC  AMU  RS  DSUUAPI  In  PVCS 

DLD 

DLDINSP 

0.5 

clarify  words  for  whats  in  "the  rest" 

8/2/2004 

12 

10 

UPC  AMU  RS  DSUUAPI  In  PVCS 

DLD 

DLDINSP 

0.5 

name  of  doc  in  review  incorrect  in  review  form 

8/4/2004 

13 

40 

UPC  AMU  RS  DSUUAPI  New  Records 

DLD 

DLD 

20.0 

wrong  msb  in  access  data  base  for  wypt  file  checksum 

8/5/2004 

14 

10 

UPC  AMU  RS  Access  DB  Create 

DLD 

CODE 

2.0 

clarify  that  OC1 .2  db  will  be  modded  for  H4.0  DSU 

8/6/2004 

15 

70 

UPC  AMU  RS  Access  DB  Create 

DLD 

CODE 

10.0 

must  remove  the  1 6, 1 7  and  1 8  personaliies  from  AMU  DB 

8/6/2004 

16 

70 

UPC  AMU  RS  Access  DB  Create 

CODE 

CR 

0.5 

wrong  number  of  words  for  MX 

8/12/2004 

17 

10 

UPC  AMU  RS  DSUUAPI  New  Records 

DLD 

DLDINSP 

15.0 

mod  so  OC1 .2  does  not  contain  any  H4.0  items 

8/12/2004 

18 

70 

UPC  AMU  RS  Access  DB  Create 

CODE 

CODEINSP 

60.0 

remove  references  to  AMU  in  H4.0  access  data  base 

8/12/2004 

19 

70 

UPC  AMU  RS  Access  DB  Create 

DLD 

DLDR 

60.0 

pilot  data  belongs  in  addition  to  new  files  in  H4.0  access  data  bai 
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Daily  Use  —  Team  Dashboard 


•  Strengths 

-  Logging  time  and  defects  is  easy 

-  Team  status  is  built  automatically 

-  PROBE  analysis  is  fully  supported 

•  Weaknesses 

-  Tasks  must  be  manually  reordered  to  support  TSP 

-  Changing  order  of  tasks  is  awkward  (at  times) 

-  Full  training  of  tool  requires  time 

-  Training  materials  are  still  in  development 
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Team  Dashboard  -  Task  List 


^  Task  and  Schedule 

Project/Task 

PT 

Time 

PV 

Plan  Date 

EV 

▲ 

1  /Project/H5.0  AV-8B  UPC/Dev/VMF/CAS  Screen/Move- Add  Buttons/HLD  Task/HLD 

0:22 

0:00 

0.1% 

Mar  19,  2006 

/Project/H5.0  AV-8B  UPC/Dev/VMF/CAS  Screen/Move- Add  Buttons/HLD  InspectTask/HLD  Inspect 

0:07 

0:00 

0% 

Mar  19,  2006 

/Project/H5.0  AV-8B  UPC/Dev/VMF/CAS  Screen/Move- Add  Buttons/PSP/Planning 

0:18 

0:00 

0.1% 

Mar  19,  2006 

1  /Proiect/H5.0  AV-8B  UPC/Dev/VMF/CAS  Screen/Move- Add  Buttons/PSP/Desiqn 

1:53 

0:00 

0.4% 

Mar  19,  2006 

^  /Project/H5.0  AV-8B  UPC/DevMvIF/CAS  Screen/Move- Add  Buttons/PSP/Design  Review 

0:31 

0:00 

0.1% 

Mar  19,  2006 

• W 

/Project/H5.0  AV-8B  UPC/^mUF/CAS  Screen/Move- Add  Buttons/PSP/Code 

1:37 

0:00 

0.4% 

Mar  19,  2006 

^  /Project/H5.0  AV-8B  Screen/Move- Add  Buttons/PSP/Code  Review 

0:34 

0:00 

0.1% 

Mar  19,  2006 

1  /Project/H5.0  AV-8^^^^BIHf/CAS  Screen/Move-Add  Buttons/PSP/Compile 

0:07 

0:00 

0% 

Mar  19,  2006 

1  /Project/H5.0  AV-S^^WDev^MF/CAS  Screen/Move- Add  Buttons/PSP/Test 

1:30 

0:00 

0.4% 

Mar  26,  2006 

/Project/H5.0  AV-S^^K/Dev/VMF/CAS  Screen/Move- Add  Buttons/PSP/Postmortem 

0:18 

0:00 

0.1% 

Mar  26,  2006 

^  /Project/H5.0  AV-8^^fc/pev/VMF/CA|*§W£en/Move-Add  Buttons/Test  Plan/Test  Devel 

0:06 

0:00 

0% 

tear  26, 2006 

^  /Project/H5.0  AV- 8 w  ^^VM  F/Ca|  Screen/Move-Add  Buttons/Desiqn  Inspect  Task/Desiqn  Inspect 

0:56 

0:00 

0.2% 

Mar  26,  2006 

i  /Project/H5.0  AV-8B Screen/Move- Add  Buttons/Test  Devel  Task/Test  Devel 

0:19 

0:00 

0.1% 

Mar  26,  2006 

^  /Project/H5.0  AV-8B  UF'C^Wvmf/CaI  Screen/Move- Add  Buttons/Code  Inspect  Task/Code  Inspect 

1:52 

0:00 

0.4% 

Mar  26,  2006 

1  /Project/H5.0  AV-8B  UPC/Dev/vtf /CA^cmen/Move-Add  B utto n s/I ntTestTask/Int  Test 

1:28 

0:00 

0.3% 

Mar  26,  2006 

Add  Task...  f  Remove  Task  Move  Task  Up  Move  Task  Down 

E  Flat  View 

Note  that  bottom  tasks  are  not  in  the  proper 
sequential  order  for  TSP  development 
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Team  Dashboard  -  PROBE  Support 


'3  PROBE  Wizard  -  Microsoft  Internet  Explorer 


PROBE  -  /Non  Project/PSP  for  Engineers/6A 

Step  1:  Verify  Estimated  Object  LOC 

From  your  Size  Estimating  Template,  your  Estimated  Object  LOC  is  102. 


IF you  want  to  alter  your  Estimated  Object  LOC,  you  should  return  to  the  Size  Estimating  Template  now 
and  make  the  necessary  changes. 


'3|  PROBE  Wizard  -  Microsoft  Internet  Explorer 


If  you  are  satisfied  with  your  Estimated  Object  LOC,  press  the  continue  button. 


'3j  Outliers  -  Microsoft  Internet  Explorer 


T J 


The  word  outlier  is  a  statistical  term  for  an  unusual  data  point. 
When  you  have  a  collection  of  historic  data  points  and  one  of  those 
data  points  is  very  different  from  the  rest,  it  may  be  an  outlier. 


PROBE  -  /Non  Project/PSP  for  Engineers/6A 

y  Historical  Data 

>ns  will  be  based  upon  the  following  set  of  historical  data: 


Identifying  outliers  is  not  a  simple  task.  You  can't  just  look  at  the 
data  points  and  throw  out  the  ones  that  don't  fall  along  the  best-fit 
line.  You  can  generally  only  decide  that  a  point  is  an  outlier  if  you  are 
familiar  with  the  project  in  question,  and  you  know  that  something 
unusual  happened  on  that  project  to  skew  the  data  point. 

For  example,  if  your  computer  were  to  crash  halfway  through  a 
project,  and  you  were  forced  to  start  over,  that  project  would  likely 
end  up  taking  much  longer  than  expected.  The  resulting  data  point 
could  fairly  be  considered  to  be  an  outlier.  On  the  other  hand, 
making  a  bad  estimate  is  not  an  unusual  occurrence,  so  you  can't 
throw  out  data  points  simply  because  your  estimate  was  bad. 


ect/Task 

Estimated 

Object 

LOC 

Estimated 
New  & 
Changed 
LOC 

Actual 

New 

Changed 

LOC 

Estimated 

Homs 

Actual 

Horns 

Exclude? 

SP  for  Engineers/IA 

125 

3 

1.52 

r 

SP  for  Engineers/2  A 

50 

39 

1 

0.73 

r 

SP  for  Engineers/3  A 

40 

73 

0.65 

1.07 

r 

SP  for  Engineers/4  A 

37 

46.0 

44 

0.73 

1.33 

r 

SP  for  Engineers/5  A 

69 

79.1 

80 

1.59 

1.05 

r 

i  feel  that  one  or  more  of  the  projects  in  the  list  above  is  an  " outlier , " you.  may  exclude  it from  the 


- 1  jiu-uii.  LuiLuiuubns  by  checking  the  appropriate  box  in  the  "Exclude"  column.  Unless  you  really  understand  what 

you  are  doing  it  is  best  to  leave  all  the  boxes  unchecked. ) 

If  all  the  information  above  is  correct,  press  the  continue  button. 


Back 


Continue  | 


J 
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Team  Dashboard  -  PROBE  Support 
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Team  Dashboard  -  PROBE  Support 


3  PROBE  Wizard  -  Microsoft  Internet  Explorer 


PROBE  -  /Non  Project/PSP  for  Engineers/6A 


Step  4:  Time 


To  create  your  tune  estimate,  use 


'U  PROBE  Method  B  for  Time  -  Microsoft  Internet  Explorer 


2.18  Hours 


Your  best 
bounds  (bi 


1.77  Hours 


r  |????? 


Your  next 


Your  next 
the  estimat 
the  total  di 
developing 


PROBE  Method  B  foi  Tune  uses 
historical  data  from  your  completed 
projects  to  help  generate  an 
accurate  estimate.  It  draws  a  chart 
using  estimated  new  and  changed 
LOC  on  the  horizontal  axis  and 
actual  time  on  the  vertical  axis, 
and  plots  a  point  for  each 
completed  project.  Then  it  draws 
the  best-fit  line  for  those  points,  and 
uses  it  to  translate  your  estimated  new  and  changed  LOC  into  an 
estimated  time  Finally,  using  statistical  methods,  it  draws  two  lines 
that  surround  70%  of  the  points  on  the  chart,  and  uses  those  lines  to 
estimate  maximum  and  minimum  likely  values  for  actual  time 


N&C  LOC 


C  2.29  Hours 


Your  next  best  option  is  probably  PROBE  method  Cl.  The  slope  of  the  line  is  within  bounds  (betal 
=  44.5  LOC/Hr). 


Est  Ob  j  LOC 


You  should  not  use  PROBE  method  B  for  time.  The  value  of  betal  is  supposed  to  be  close  to  m - 1 

your  historical  productivity  (63.3  LOC/Hr);  unfortunately,  it  is  not.  (betal  =  -740  LOC/Hr)  |  ■ 

The  value  of  betaO  is  supposed  to  be  significantly  smaller  than  the  time  you  are  currently 

estimating;  unfortunately,  it  is  not.  (betaO  =  1.12)  - • - 

EstN&C  LOC 


You  cannot  use  PROBE  method  A  for  time.  You  do  not  have  enough  historical  data. 


Choose  your  time  estimate  from  the  options  above,  then  click  the  Continue  button. 

Back  |  |  Continue  | 

zi  _ 
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Team  Dashboard  -  PROBE  Support 


3  PROBE  Wizard  -  Microsoft  Internet  Explorer 


- 3 

PROBE  -  /Non  Project/PSP  for 

Engineers/6  A 


Step  5:  Check  Estimates 


You  have  estimated  that  this  project  will  require: 

•  1 12  New  and  Changed  LOC 

•  3  Total  Hours 


This  translates  into  a  planned  productivity  of  37. 3  LOC/Hr,  which  is  much  lower 
than  your  'To  Date'  productivity  of  63.3  LOC/Hr.  This  is  usually  a  warning  flag, 
indicating  that  you  have  probably  underestimated  size  and/or  overestimated  time. 


You  should  re-evaluate  your  estimates,  and  possibly  adjust  your  size  estimate 
and/or  time  estimate. 


Back 


Continue 
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Postmortems  -  TSP  Workbook 


•  Strengths 

-  Compiles  team  defect  log  automatically 

-  Easy  to  generate  charts  from  data 

•  Weaknesses 

-  None 
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Postmortems  -  Team  Dashboard 


•  Strengths 

-  Compiles  team  defect  log  automatically 

-  Data  analysis  charts  provided  within  tool 

-  Easy  to  export  data  to  Excel  (easy  to  generate 
charts  from  data) 

•  Weaknesses 

-  None 
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Summary  Conclusions 


•  TSP  Workbook  and  Team  Dashboard 

-  are  successful  implementations  of  fundamental 
PSP/TSP  concepts 

-  are  neither  “Silver  Bullets”  nor  perfect 
implementations  of  all  PSP/TSP  concepts 

-  can  be  used  to  execute  a  TSP  project 


•  Expect  to  work  with  your  PSP/TSP  tool  to 
determine  how  your  team  will  use  it 
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Contact  Information 


•  Brad  Hodgins 

-  phone:  (760)  939-0666/4446 

-  e-mail:  bradley.hodgins@navy.mil 

Note:  These  slides  are  not  on  the  SSTC  2006 
CD.  Please  email  me  if  you  wish 
additional  information. 
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Abbreviations 


•  COTS  -  Commercial  Off  The  Shelf 

•  NAVAIR  -  Naval  Air  Systems  Command 

•  NSSC  -  NAVAIR  Systems  Software  Support  Center 

•  PROBE  -  PROxy  Based  Estimating 

•  PSP  -  Personal  Software  Process 

•  SEI  -  Software  Engineering  Institute 

•  STSC  -  Software  Technology  Support  Center  (Air  Force) 

•  TSP  -  Team  Software  Process 
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